THE INTERACTION BETWEEN MULTI-OVERLAPS IN THE HIGH 
TEMPERATURE PHASE OF THE SHERRINGTON-KIRKPATRICK SPIN GLASS 



NICHOLAS CRAWFORD 

Department of Statistics, University of California at Berkeley 

ABSTRACT. In this paper we explore the joint behaviour of a finite number of multi- 
overlaps in the high temperature phase of the SK model. Extending work by M. Tala- 
grand, we show that, when these objects are scaled to have non-trivial limiting distribu- 
tions, the joint behaviour is described by a Gaussian process with an explicit covariance 
structure. 

1. Introduction 

The recent text f/J provides a beautiful introduction to interpolation and the cavity 
method and their use within the realm of mean field spin glasses. In the particular case 
of the SK model it provides detailed information about quantities of physical interest. 
It was used at high temperatures to compute the quenched free energy of the system 
precisely |6 J. Moreover the ideas are interwoven with more sophisticated interpolations 
to obtain upper bounds on the free energy at all temperatures, 0, and, ultimately, to 
express this quantity in terms of a variational principle predicted by G. Parisi (H. 

Recall that the SK model of spin glasses is defined as the Gibbs measure on spin con- 
figurations o~ G {— 1, 1} N with the Hamiltonian 

1 N 
h n(o-) = -Trf&jWi + h E a i- 

l<i<j<N V N i=l 

Here the couplings are taken to be independent Gaussian random variables with 
mean and variance 1 and h G 1R is the strength of the external field which may, without 
loss of generality, be assumed to be positive. In other words, each spin configuration is 
chosen with probability 

P(o-) cx (P U »V) (1.2) 

where we have omitted the minus sign from the exponent for convenience and the pa- 
rameter B denotes the inverse temperature. 
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Let a 1 , a 2 € {— 1, 1} N denote a pair of spin configurations and let the overlap between 
a 1 , a 1 be defined by 

-i N 

*V = JjL°i<>i- (1-3) 
i=l 

M. Talagrand [7J showed that for high enough temperature, there exists a value 1J2GK 
so that 

e[((Ri, 2 -<? 2 ) 2 )] <^ (1.4) 

for some constant L > as N, the number of spins in the system, tends to 00. Here (•) is 
the quenched Gibbs state on N spins and v (•) E [•] denotes the average over the disorder 
of the system. 

Further, considering the quenched Gibbs state for n replicas, in Sections 2.5, 2.6, and 
2.7 of |7J, Talagrand develops the machinery needed to compute the joint distribution of 
the scaled random variables 



{vN(R v - qz)}{W}(z{l »}• (1-5) 

Here the replicas {c^} are spin configurations sampled independently according to the 
quenched Gibbs state with the same realization of disorder. 

Once the control ( |1.4| of the overlaps is obtained, it may be shown via the cavity 
method that in this high temperature regime, many quantities of interest are concen- 
trated in the above sense as well. For example, it is of physical interest to ask about the 
behaviour of the magnetization 

j N 



M=-£> (1.6) 

under the quenched Gibbs state. This random variable is concentrated, and if we denote 
by c\\ the value that M concentrates around then we can immediately generalize the 
above and ask about the joint distribution of 



{VN (R l4 , - q 2 )}{W}c{l n} {VN {M e - <?i)} £e{1 n y (1.7) 

Towards the end of Section 2.7 of 0, a generalization of this problem is proposed: 
Given a subset S C { 1, . . . , n } of replica indices, we may introduce the multi-overlaps 

-1 N 

Again, given ( |1.4) , it is not difficult to show that these objects are concentrated around 
certain values q\§\, where |S| denotes the cardinality of S. The general challenge is to 
characterize the joint distribution of the scaled variables 

{VN(R s -q ls] )} sm n} . (1.9) 

This is the question addressed in the present paper. We shall not give a precise descrip- 
tion here, as it requires the introduction of a bit of notation, however let us simply say 
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that the joint distribution is given by a Gaussian process with an explicit covariance 
structure. 

Unfortunately there is no magic bullet here (besides the miracles inherent when work- 
ing with Ising variables). Our results are proved by the method of moments, identifying 
the underlying covariance structure first and then inductively computing joint moments. 

In the next section, we shall introduce this notation and give the main results in a 
precise way. Subsequent sections are devoted to proving these results. We will proceed 
with proofs in a general pattern. It turns out that the characterization of distributions 
decrease in difficulty as | S | increases. Thus we always proceed from easiest to hardest 
case (the magnetizations being basically the most difficult). This creates redundancy, 
but probably increases readability. 

Finally, let us mention some overlapping work related to this result which we became 
aware of during the preparation of this paper. Besides the standard on the subject to 
which we refer below, the paper U treats this problem with no external field, however 
this represents a significant simplification over the general case. Also, that paper is in- 
terested in a detailed expansion of the corrections to computed moments. Another work 
which shares some features in common with the present work is (4|, which considers 
the behavior of the random variables {o~iO~j}- 



2. Notation and Results 

Throughout the following, the constant C > will be used to denote a quantity that 
does not depend on N, though it may depend on ft and the number of replicas in the 
quantity of interest. This value will change from instance to instance. We shall further 
(following Talagrand) use the notation 0(k) to denote a quantity bounded by i n 

N 2 

absolute value. 

Let us denote the truncated spins by 

&i l = of - {at} (2.1) 

where the superscript indicates the replica of interest and the subscript indicates the site 
of interest. 

Let q2 denote the solution to the equation 

q 2 = E [tanh 2 (jS^Y + ft)] (2.2) 

where Y is a standard Gaussian. A result of Guerra and Latala J3J 13 shows that there is 
a unique solution for qi whenever h > 0. Let us further denote 

^ p = E[tanhP( j 6^2^ + ft)]- (2-3) 
To prove the multi-overlap CLT we need high temperature conditions based on the 
work of Talagrand. We assume in what follows that the quantity N(R-[ / 2 ~ ^i) 1 has an 
exponential moment. This is the content of the following theorem. 
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Theorem 2.1 (Theorem 2.5.1 of [7]) There exists /3o > (independent of h) such that if 
j6 < /3o we have 

t/(exp^(R 1/2 -^ 2 ) 2 ^ <L (2.4) 

for some L > 0. 

For each finite subset S C N and p G N U {0}, let us introduce the following quantity 
which generalizes truncated overlaps defined by Talagrand in 0: 

-i N 

T s,P = ^LU^^y whenS^0 (2.5) 

and 

j N 

T ^p = v " ^ when S = - (2 - 6) 

In the case p = 0, we shall often denote Ts,o = T$. We remark that this last notation 
matches Talagrand's definition when |S| =2 but not when |S| G {0/1}- Also whe 
S = {£}, we shall denote T$ iV = T^„. It seems an appropriate time to mention that below 
the reader will encounter ranges of indices that may lead to empty sums or products. It 
should be clear from the context, but we mention here that in all cases empty sums are 
interpreted as and empty products are interpreted as 1. 

Our interest in these quantities stems from the fact that we may express the multi- 
overlaps of the SK model in terms of them: 

-i N 

^E^"--<-^= E T S,r-\S\- (2-7) 
«=1 SC[r] 

Here the notation [r] is used to denote the subset {1, . . . ,r) C N. 

To prove the CLT for multi-overlaps, we will first characterize the joint distribution of 
the quantities 

{vNTs /P }sc[n],peNu{0}- ( 2 - 8 ) 
This characterization goes by the method of moments, facilitated by the fact that whn- 
ever S A S / 0, the families 

{VNT S/P } peN u{0}/ W NT s, P } P GKu{0}- ( 2 -9) 

are asymptotically finitely independent. 

It is notationally convenient for us to introduce a number of quantities defined in 
terms of the moments {q p }peN which come up naturally in the calculations below. 

Q p = q p - 2q p+2 + <7 p+ 4 (2.10) 

U +1 - qp+3 if P >-i 

v [0 else V ' 

cp p = pn p -2 ~ 3n p (2.12) 
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Let us further introduce the quantities 



A s{P'P) 



i_ P 

y+P ' n^P^P ' 



N 



+P 2 Ptt p a 2 (p -1,0) 



if s > 3. 
if s = 2. 

if s = 1 



(2.13) 



if s = 



where 



A, 



P 2 \ P A (2,p) + J S 2 Kp, ? Ai(l / p-l) 
+ j 6 2 o;p,pA 2 (2 / p-2) 



p + 1 
p-2 - ?p?2) + ( 2 



(<7p+2 - 



P 2 (?P 



q P qi) ■ 

PP {iv ~ - V (P + !) (^?P+2 - ^p^) 

(<?p+2 - ^p^?2) • 



A comment on the cases s = 1, is in order. Setting p = 1, (resp. p = 2), we may solve 
the equation for all p and then apply the result to the solve general case. 
The actual values of A s (p, p) are less important than their significance: 

Theorem 2.2 (The Covariance Structure of the Truncated Family) Suppose that S,ScN 
are finite subsets. Then for any fixed p, p S N, 

1 ' (P,P) (2-14) 



T S,p T S,p 



N S s,s A \s\ 



Remark 1. In the cases |S| = 2, p = p = and |S| = 1, p = p = 1, an easy calcu- 
lation shows that this formula agrees with the moments computed by Talagrand (as it 
should. ..see Theorem |2.3| below). 

In what follows let {Ys,p } be a family of Gaussian random variables independent from 



the randomness in the SK model with joint covariance structure given by Theorem 2.2 



As mentioned above, to prove the assertions of this paper, we shall rely on computations 
due to Talagrand which can be found in Sections 2.5, 2.6 and 2.7 of (7|. The upshot of 
these computations is the following. 

Theorem 2.3 (Theorem 2.7.3 from |7J) Let n£N be fixed. Consider the collection of subsets 
S C [n] with \S\ < 2. Let us fix a collection of integers k(S) associated to these subsets. Let 
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k = Esc[n]:|S|<2^(S)- Then 




N 



n ey; 



k(S) 



(2.15) 



SC[n]:|S|<2 

In light of this result, the main theorem of our work reads as follows. 

Theorem 2.4 (The Full Picture) Letm,n S Nbefixed. Consider the family {Ts /P }s C [n] / o<p<m 
and an arbitrary collection of integers {k (S, p)}sc[n],o<p<m- Let k = Y,(s,p) k ?)■ Then we 
have 



n T k s f p) 

As,p) 



N 



Sc n 



p=0 



k(S,p) 
S,p 



N~ 



(2.16) 



There is an obvious corollary to the previous theorem: 

Corollary 2.5 Let n G N be fixed. Then the family {s/N (Kg — ?|s|)} scjn ] zs jointly normal 
with an explicit covariance structure that can be recovered from Theorem [Z4| combined with the 
fact that 

R s~q\s\ = I] T s',\s\-\s'\ ( 2 -l 7 ) 

S'CS 



3. Preliminaries 

The single most important tool in this work appears in 0. It is a consequence of the 
cavity interpolation scheme. Let us recall briefly the idea. Let = {— 1,1} N and let 
be the space of n replicas. On we isolate the final spin and denote it by e while in 
the space of n replicas we denote the n final spins by e 1 , . . . e". 

In the case n = 1, this final spin feels an effective field from the previous N — 1 spins 
which takes the form 

\ 

Pn{o~) = -t= E + h. (3.1) 

V N i<N 

In order to study the effect of this field we introduce the interpolation 

H N (t) = H N + Vtp N {o-)e + Vl^t{^Y + h)e (3.2) 

where Y is a standard Gaussian and q2 solves the equation ( |2.2[ ). Let us define (•)( denote 
the Gibbs state corresponding to this Hamiltonian at inverse temperature /6. We use the 
same notation for the Gibbs state on E^ defined by drawing n independent copies of a 
with respect to the same realization of disorder. It will be clear from the context which 
state we are interested in. Finally we let 

v t (f)=E[(f) t ] (3.3) 

for each / : E^ — > K. 

The key lemma, proved in (7|, is as follows. 
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Lemma 3.1 (Proposition 2.5.3 from 0) Suppose ySo is as in Theorem 2.1 Let f> < /5o- Then 
for any f on E^, 

\v{f)-Vo(f)\<^v(f 2 ) 1 (3.4) 

|v(/)-Vo(/)-^(/)|<^v(/ 2 )^. (3.5) 

Our main function of interest below will be of the form 

v {Ts , P0 G) (3-6) 

where Q is a monomial in the variables {Ts,p}sc[n],o<p<m So C [n],po £ N. We 
will need to expand this product in terms of replicas. We will always use the following 
notation when making such an expansion. 

To represent Q in terms of a disjoint set of replicas, consider a total ordering of the 
factors Ts r v appearing in Q. Denote this ordering by A. Recursively suppose we have 
introduce replicas up to the index a G A. If T$ r p corresponds to the index a, define a pair 
of injections a a : S — > N and j a ■ [p] — *■ N so that their images are disjoint from [n] and 
the images of the previously defined maps. Finally we distinguish a pair of injections 
£ : So — > N and r/ : {0, . . — > N whose images are disjoint from each other, all, 
previous images and [n] . Thus, to be explicit, we may expand the factor T$ iP as 

1 N 

Ts, P = ^EU^-< a{r) )^--^" {P) (3-7) 
JV i=l res 

Note that for each replica £ £ [n], there is a unique factor T$ „ of ^ which depends on this 
replica. We shall denote this dependence by Ts /P (£). 

We record a general computation that we shall use repeatedly in various contexts 
below: 



8 



N. CRAWFORD 



Lemma 3.2 Let S, p be fixed. Let n be large enough so that S U £ (S) U r\ ([/?]) C [n\. Suppose 
f - : -» R T/ien 

vfnf^-^lfl^rl = 0(2)v((T) 2 ) 3 !f|S|>3. 



res ;=i 
o2 



/3 ?p vo [f [R rvr2 - R rM - R an)/n + R anUir2h 

+ 0{2)v({f-) 2 ) 1 ifS = {r Xl r 2 }- 



= ?n p _ 2 £ vo (/" {R- /V{1) - RanUd))) (3.8) 

i<;<p 

«{ri^(n)}U 7 ([p]) ' 

- /3 2 n7r p i/ (/- - R an)in+l 

+ o(2)v((f-) 2 ) 1 ifS = {n}. 

Finally, if \S\ = O r 

v ( - ?p ) /- ) = f (q v _ 2 - q p q 2 ) £ v o (f~ fe ~ qi 

\V=1 / / 



+ P 1 {q P +2-q P q2) E v o (/ [R^-qi 

{e,f}nt]([p})=0 



+ p 2 (q p -q p q 2 ) £ v (f [R e/ , - q 2 



i<e<p 
p<£'<n 



p 2 n(q p -q p q 2 ) £ v (/ (% +1 -ft 

1<1<P 



- p 2 n(q p+2 -q p q 2 ) £ v (/ (% +1 -ft)) 

p<£<n 

+ /5 2 ^±H (^ p+2 - v (/- (R- +1/f!+2 - ft)) + 0(2)1/ (CT ) 2 )^ • (3.9) 



Proof. Lemma 3.1 asserts that for any / on E^, 



K(n). 



I v (/) " v (/) - V& (/) | < (/ 2 ) 2 . (3.10) 

Substituting for / the appropriate functions from our hypothesis, and using the inde- 
pendence of the last coordinate from the first N — 1 in the vq measure, we see that the 
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second term on the left vanishes in all cases. It therefore suffices to compute 

v 'o (Yl {? - fl^rj v' ( (f\e^ - ^ f^J ■ (3.11) 
Applying Formula 2.169 from Q, 

\res ' 1=1 J 



{4«'}C[w] \res ;=i / 

e ^ofn( £r - £C(r) ) n £,?a) ^ n+1 Vo(r 

l<^<[n] VeS l<Kp / 

+ /3 2 ^±^ (W " W\ fle^e^A v (f _ - ^) (3.12) 



res ;=i 



and similarly for nf=i e 
Notice first that 



v n ( e '' - £C(r) ) fl^W = (3.13) 



whenever there is a factor (e r — e^W) 'free' in the sense that {i,£'} Pi {r, £(r)} = or 
when {£,£'} = {r, £(r)}. When |S| > 3 this is always true, so the first assertion of the 
lemma follows. 

Consider the case |S| = 2. For definiteness let us take S = {/i,^}. After the dust 
settles the only contributions come from the cases 

{tJ'}e{{ri,ar2)},{r2,C(ri)}}. (3-14) 
This leads to the expression 



Va 



L I lf r i - An) \ ( F ri _ P Z(r 2 )\ r^ £ '/(0 f- 



i=i 



v 



fi 2 v ^-e^>) ^-e^jlle^h^e^J x 

If we calculate the first factor in terms of the values {^sjseN the assertion for |S| = 2 
follows as well. 

Consider next the case |S| = 1. Letting S = {ro} for definiteness, we can, by replica 
symmetry, conclude that the summands in ( |3.12[ ) for which {£,£'} D {fo/f ( r o)} = 
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when {£,£'} = {r, £(r)} all vanish. Since 



I/O 

we have 



£ r o _ e C( r o) 



1/0 



i=l 



(3.16) 



o 



n^ (0 / 



i=i 



+ P E 

«{r ,C(ro)}U7(b]) 



/=1 



Mr R 



R 



j8 nv 



y[ £ n{i) £ r 0£ n+i 
1=1 



vo[f-[R-, n+1 -R 



£(io),n+l 



(3.17) 



The assertion now follows via calculation of the factors involving e's in terms of the 
values {fcjseiN- 

In the final case, no a priori cancelations can be made. Our assertion follows directly 
from a calculation of the resulting factors involving the e's. □ 

Our strategy is to use the previous lemma and an induction argument to calculate mo- 
ments to within an error which is of higher order than the moment under consideration. 
This entails getting bounds on the error term of the previous lemma, when the function 
/ is a monomial in the truncated multi-overlaps. The next lemma follows (modulo a 
bit of work) from the exponential bounds for overlaps proved in Section 2.5 of J7|. We 
shall provide a proof in the Appendix in order to keep this paper self-contained. Let us 
introduce here a notation that is pervasive below. Let 



N-l 



t s, p = EriK-Hx^ 

1=1 reS 



(3.18) 



Lemma 3.3 For each n, m G N, consider the joint collection {Ts,p}sc[n]jd<v<m- Then for any 
fixed collection of integers {k (S, p)} sc[n]jo<v<m 



(n n tT p p) ) 

\Sc[n}0<p<m J 



(3.19) 



where k = Y^sp k (S/ p)- Similarly, for any fixed collection of integers {k (S, p)}sc\n 



],0<p<m 



n n vs.v 

v Sc[n] 0<p<m 



k(S,p) 



< 



c_ 

N-2 



(3.20) 



where k = £ s „ k (S, p). 
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We proceed to identify the co variance structure of the process {Ts /P } in a series of 
lemmas. We begin with observations which are the basis of the calculations below. For 
ease of notation, let us restrict to the case \S\, \ S\ > 1. The remaining cases are similar. 

Using the symmetry of v, 

- i T s,pTs, P ) = v (n (? - e?(r) ) n «* (,) 0.2D 

\reS l</<p / 



where // are injective integer valued functions as defined above Lemma 3.2 
Note that 

(GS i</<p 

wherea : S — > Nand7 : [p] — > Nare injective with ranges disjoint from {S,S,^(S),J/([p])} 
and each other. We have 

/ Y\(e r -e^) n e ' ?( ' )r s, ^ 

1 



v rGS l<l<p , 



iiu-e^) n £ ,(i) n K- £ * (r) n £7(0 

rGS l</<p rGS 1<'<P y 



v reS l<Kp / 



Lemma 3.4 Suppose n,m S N is fixed. Let S,S C [n] so f/zaf S ^ S. Lef < p,p < m. 
Then 

v { T s,pT§, P ) = O (3) (3.24) 

More generally, let Q be a monomial in the truncated multi-overlaps {Ts>,pi}s'<z{n\,p'e[m\ 
total degree k. If So ^ S' for all factors ofQ, then 

v(T SoiPo G) =0(k + 2) (3.25) 

for any po G N. 

Proof. We shall only prove the statement for co variances. The more general statement 
follows from similar, but more involved computations. For notational convenience, we 
restrict attention to the case that |S |, |S | > 1, the remaining cases following similar argu- 
ments. Consider first the term 

iv ( n u - & r) ) n ^ n r - ^ {r) ) n ^ 

\res i</<p reS i<'<p / 

from ( 3.23| . Using Lemma 3.1 to approximate this term via the cavity method, notice 
that the left endpoint of the interpolation vanishes whenever SAS 7^ via symmetry. 
Thus in all cases this term is 0(3). 
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We claim that 




Mr) 



n ^ 1)t s,p) =°( 3 ) 
i<i<p j 



(3.27) 



as well. Without loss of generality, we may assume |S| > |S|. The first observation to 
make is that if |S| > 3 then Lemmas 3.2 and 3.3 give the conclusion immediately. 

The remaining cases follow from more delicate cancellations. We may assume (with 
our initial assumption that neither S nor S is empty still in place) that | S | = 2 and will 
denote S = {/i,/^}- By Lemmas 3.1 and 3.2 




!<}<p 



R ari),ri +R ari),Ur 2 ) 



+ O (3) (3.28) 



where we have again employed Lemma 3.3 to bound the error term. Applying Lemma 
|3ll 



T l P [ R n,r 2 



R 



v I T S,p ( Rrun 



R riZ(r 



R 



+ R 



+ 0(3) (3.29) 



By assumption, S can involve at most one of {r\, r{\, it is easy to check that 



R 



+ R 



The remaining cases follow from similar considerations. 



(3.30) 

□ 



The previous lemma will be key in diminishing the pain of determining non-trivial 
covariances. The other helpful step was taken already by Talagrand, who computed 
the variances of T{i,2}/ ^i,i ^ T ,2- As should not be a surprise, these prove to be the 



most fundamental truncated overlaps. To prove the remainder of Theorem 2.2 
specialize the analysis to the various cases. 



we must 



4. The Covariance Structure 



We begin this section with a small computation. By employing the Lemma 3.1 and com- 
puting the left endpoint expectation directly, we have the preliminary observation 



N 



n £) - < 



ar) 



n z W) n 



KKp 



,r _ a(r) 



n 

\<i<p 

\s\ 



^L^)(- 1 ) e ^2i + 0(3) (4.1) 



We begin with the simplest case: 
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Lemma 4.1 Suppose n G N is fixed. Let S C [n] and p, p G N be fixed. If\S\ > 3, f/zen 



v { T s,pTs,p) 



1 g f|S| 



N 



-1) q p+p+2 i + 0(3) 



Proof. We shall use ( 3.23| . Since |S| > 3, Lemmas 3.2 and 3.3 imply 

0(3) 



Mn^ r - e?(r) 



n ^ 



The assertion then follows immediately from (4.1 1. 
Lemma 4.2 Suppose n G N is fixed. Let S C [n] and p,peN be fixed. If\S\ = 2, then 



(4.2) 

(4.3) 

□ 



{Ts, p T s ,p) 



1 £2 4 



Proof. From ( 3.23| l and ( [4.1| |, it is enough to identify the value of 



«<in( er - e?(r) ) n £ii(l)T i 

<reS l<l<p 



S,p 



(4.4) 



Let S = {r\,r2} for definiteness. Note that 

R n,r 2 ~ R r lf £(r 2 ) ~ ^(n)^ + R Un)Z(r 2 ) = 

With this identity we have, by applying Lemmas 3.1 3.2 3.3 and then Lemma 3.1 
again 



T n,r 2 - T n,ar 2 ) ~ T an),r 2 + T Z{n)Z(r 2 ) ( 4 - 5 ) 



once 



K reS i<;<p 

2 2 



n ^Kp) 

<1<P ) 



[ T S,p [ R n,r 2 - R- Z[r2) ~ R an) , r2 + R mm) ) ) + O (3) 

= Pdv v ( T s,p (jn,r 2 - T n z{r 2 ) ~ T an) , r2 + ^1)^2))) +0(3). (4.6) 
Now Lemma [3~4| implies 

TruAr, + Trfr, 1 rr~\\) = V {T s ,pT ri ,r 2 ) + 0(3). (4.7) 



V [Ts,p (T n ,r 2 ~ P n ,l(r 2 ) ~ T an),r 2 + Tfa U(r 2 ) , 

To summarize, we have shown that 

1 

N' 

Since p and p were chosen arbitrarily in the preceding, specializing to p = we may 
employ this approximate identity to see that 

1 



v {Ts,pTs,p) 



-Q p+ p + p 2 Q p v[Ts,pT s )+0(3). 



(4.8) 



v { T s,pTs) 



N 



Qp + f5 2 Qpv{T 2 s )+0(3). 



(4.9) 
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To finish, we rely on Theorem |2.3| which tells us that 

v ( T s) = r^+°( 3 )- ( 4 - 10 ) 

Combing these approximations together gives the result. □ 



For the next two Lemmas (the cases |S| < 1), it is convenient (not to mention more 
compact and instructive) to give approximate identities for the covariances rather than 
full formulas. One can easily construct the corresponding formulas iteratively. 

Lemma 4.3 . Let Y\, p,p6N be fixed. Then 

V { T ri, P T ri ,p) = Jj n p+P-1 + f [V n p-2 - (P + 2)7T p ] V (T rii pT riil ) 



+ p z pn p v [T {lt2}i p-{T {lt2} ) + 0(3) (4.11) 
where we interpret a term with a coefficient as evaluating to 0. 

Proof. To fix notation, let S = {r\}. Let £, rj,a and 7 be integer valued functions as in 
( |3.23[ ). By Lemma [31] 



N 



i<i<p 



n 

i</<p 



P 7(0 



71 



p+p-l 



Thus, from ( 3.23| , it is enough to identify the approximate value of 



n,p 



(4.12) 



(4.13) 



n 

\<\<p 

As usual, we apply Lemmas 3.1 3.2 and 3.3 Note that the Lemmas 3.1 and |3.3| imply 
that for any triple a, b, c S N, 



"0 ( T~ iP (R~ a>h - R~ b 



Xp (Ra,b-Rc,b))+0(3). 



Further, if T ri/P does not depend on the replicas b, c 

v [ T n,p {R a ,b ~ R c ,b)) = v {T n ,pT ri ,i) . 
The resulting symmetry allows us collect terms to get 



(4.14) 
(4.15) 



ei (l) T ri .p) =p 2 [pn p - 2 -(p + p + 3)TT p ]v{T rirP T ri/1 ) 
i</<p / 

+ fS 2 pn v v (r„ /P ( 7 (l)) (R riMl) -R an)Ml} )) +0(3). (4.16) 
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To compute the last two summand we introduce the identities 

R fl,b =T{ a ,b} + T U/ i + T b/1 + T + q 2 
R nMi) ~ %n),7(i) =T {'-i,7(i)} ~ %(>-i),7(i)} + T '-i4 - T C(n),l 

R r lA (n) ~ %n),«(ri) = T {r lA ( ri )} - %(ri), a (n)} + T n,l ~ T C(ri)A 

Further, we have 

T n,p(«(!)) = T n,p ~ T Kmf p 

t /-i,p(t(1)) =^(7(1)) - T n,p( z °) + T '-i,p( z o) = r {ri/T(1)};P _ 1 + T ri/ p 

where the index zo is disjoint from those already under consideration and the second 
identity only makes sense if p > 0. 

Let us now collect terms, applying Lemma [3~4| whenever possible. We have 

v = v +0(3) 

v ( t »-i,p(7(1)) (XvHi) =v ( T {i,2},p-i T {i,2}) + v ( T n,pT {n}/1 ) +0(3) 

This gives us the approximate identity 

v (Tr llV T ri ,p) = ^TTp+p-i + f [V n v-i - 3/r P ] v (T ri ,pT ri/1 ) 

+ p 2 pn p v (T { v,},p-iT {u} ) + 0(3) (4.17) 
where we interpret a term with a coefficient as evaluating to 0. □ 
Lemma 4.4 Suppose n G N is fixed. Let p, p S IN be fixed. We have 

v {T , p T 0i p) = — (q p+p - q p q p ) + j6 2 A p v (T 0iP T 0i2 ) + fi 2 K PiP v (T^p-iT^i) 

+ £ 2 o; P/P i/ (T {W _ 2 T {1#2} ) + 0(3). (4.18) 



Proo/. Let ?/ and 7 denote functions as in ( 3.23 1 which map [p] and [p], respectively, into 



N. By Lemma 3.1 



iv ( m^o - 9 j yrpm - ??J j = ^ - + op). (4.19) 

From ( 3.23| and ( |4.1| |, it is enough to identify the value of 
In the following calculation, we write 
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Lemmas 3.1 and 3.3 imply that for any pair (a, b), 

Vo(T 0iP (R; rh -q2))=v(T , p (R a/h -q 2 ))+O(3). (4.22) 
Recall Lemma 3.2 in the present case. The symmetry resulting from \A.22) allows us to 



write 

' v 



\ \ v(v — 1)/ / 

Yl £V(1) -ip) T 0,p) = f (</p-2 - ivi?) 2 v ( t 0,p (^(1)^(2) - 12 

+ P 1 (<7 P - Ipli) Ppv (T 0/ p(7(l)) (R^(i) /7 (i) - qi 
+ /3 2 {q P+ 2 ~ q P qi) P{P ~ (t , p ( 7 (1), 7 (2)) (R 7 ( 1)7 ( 2) - qi 



~ f (?p - ?p?2) (P + P)V V ( T 0,P ( R >7(l),z - <?2 

- £ 2 (<? P +2 - q v qi) (p + p)pv (T 0f p(y(l)) (R 7 (i )/2 - <?2 

+ i 62 (P + P)(P + P + 1 ) (^ +2 _ 9p?2 ) v ( T0 . ( Rz2+1 _ ?2 )) . (4.23) 

For each pair {a, b}, we may write 

Ra,b ~qi = T{a,b} + Ta,i + T w + T 0/2 . (4.24) 

For the first, fourth and sixth terms, Lemma 3.4 and this expansion allow us to replace 
v (T 0/ p (R aib - q 2 )) by v {T , p T ,i) + 0(3) 

To handle the second and fifth terms we introduce a new replica z which replaces 7(1) 
and write 

T 0,/5(7(l)) = T 0,p (?(!)) - T 0,p( z ) + r 0,p(z) 
=7 7 (i),p-i + T 0/ p 



Applying Lemma 3.4 once more gives, via symmetry, 

y (t ,p(7(1)) (Ky^jb -qi)) = v (Ti,p-iT u ) + v (T 0>p T , 2 ) + 0(3). (4.25) 
To handle the third term we make a similar expansion of T 0/ p(7(l), 7(2)). We find 

v (r 0/P ( 7 (l),7(2)) (R 7(1)7(2) -q 2 )) = 

v (^{i / 2} / p-2r { i /2 }) + 2i/ (T^p-iT^i) + v (T 0/ pT 0/2 ) + 0(3) (4.26) 

All in all, we have 

v (T 0iP T 0iP ) = — (q p+p - q p q p ) + fi 2 A p v (T 0/P T 0/2 ) + fi 2 K PiP v (Ti /? _iTi,i) 



+ jS^v (T {W _ 2 T {1/2} J + 0(3). (4.27) 

□ 
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5. The Identification of Moments 

Finally we are in a position to compute the joint moments of the truncated overlaps 
{Ts„}. As usual, we work from the easiest to hardest case. 

Theorem 5.1 (Joint Moments: \S\ > 3) Let m,n G N be fixed. Consider the collection 
of subsets S C [n] and the associated family {Ts,p} sQn],o<p<m- Let {k (S, p)}sQn],p<m be a 
collection of non-negative integers such that k(S,p) = if \S\ < 2. Let k = YIy=\ k (St P)- 
Then 

( > in 



n 4 S,P) 



l sc[„] 
\0<p<m 



< 



,,1+1 



(5.1) 



Proof. We shall prove this statement by induction on k, the case k = 1 is an easy com- 
putation based on our current knowledge (Lemma |3.1| , and k = 2 was proved as part 
of Theorem 2.2 in Section [1J Let us distinguish one particular pair (So, po) such that 
k{So, Po) 7^ 0- For notational convenience let 



T= t 



fc(So,po)-l 



Sq,Vq 



n n, 

(S,p)/(S ,p ) 



k(S,p) 



(5.2) 



By symmetry, we have 



n nf p) 



sew 
\0<p<m 



Po 



(5.3) 



/ 



We expand each of the factors Ts',p' hn J 7 around T g , „ with T denoting the constant 
order term. Applying Lemma 3.3 to estimate the resulting summands, we have 



/ 



n T k sfA =v(n^-^ r) ) n 

SC{n] / \reSo l</<po / 



\ SC[n] 

\0<p<m 



,7(0 



N 



!</<p reS 



i<;<po 



T, 



7(0 



(S,p)/(S , P o) 



,reS 



!</<po reS 



l</<p S,p/ 

+ 0(fc + l). (5.4) 
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Now Lemma |3"3| implies 



v 



2\ 2 



O(fc-l) 



T. 



2\ 2 



o(/c-2; 



when k(S,p) ^ 0. Therefore, via Lemmas 3.1 and 
/ 



3.2|we have 
T 



IT t s,p P) = A (*(So,Po) - 1) A |So| (p ,po> 

sew / JV V i S ,po/ 



sc[n] 
,0<p<m 



(S,p)^(S ,po) v 



+ 0(fc + l) (5.5) 

where we interpret a term in which a coefficient evaluates to as being 0. Expressed 
another way 



Yl T k s {S ' p) 



,0<p<m 



L S,p 



N 



£ E [y S;P Y So , Po ] v + Oik + 1). (5.6) 

sc[„] \ al S,p / 



From the induction hypothesis, 



ais, f 



J 7 ] = E 



seW 
0<p<m 



yfc(So,po)-l 

So,Po 



n *f ' p) 



(S,p)^(S ,p ) 



+ 0(fc-l). (5.7) 



The theorem now follows easily from the assumption that the collection {Ys,p} has the 
specified Gaussian covariance structure. □ 

Theorem 5.2 (Joint Moments: | S | > 2) Letm,n G Kbefixed. Consider family {Ts,p} sc[n],o<p<m 
and let {k (S,p)}s<z[ n ],o<v<m ^ e a collection of non-negative integers such that k(S,p) = if 
\S\ < 1. Let k = Z%ik(S,p). Then 



( 



n ij: 



sew 
\0<p<m 




AT*' 2 Yl E 
sew 



n y k s {s,p) 



0<p<m 



l S,p 



< 



C 



N~ 



Proof. Let 



(5.8) 



(5.9) 



S:|S|>3 

0<p<m 



\S\=2 
0<p<m 
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Let /c2 be fixed for the moment. Then assuming that we have proved the statement when 
k\ = 0, the case k\ > (and ^2 fixed) follows by an induction argument nearly exactly 
as in the previous theorem. Thus we may as well assume k\ = 0. 
Let 

fc 2 =E fc (S,p). (5-10) 



| S | =2 
P>1 



We shall prove the stateme nt (w ith k\ 
of Talgrand's CLT (Theorem 



2.3 



0) by induction on k^. The case kz = is part 
in this paper). The induction hypothesis for kj_ takes the 
following strong form. Let us fix a collection of exponents {k(S, p)}|s|=2,o<p<w Suppose 
that (So, po) is chosen so that po is maximal with k(So, po) ^ 0. If there are multiple 
choices of So we choose arbitrarily among those with A; (So, po) maximal as well. As an 
induction hypothesis for k^, let us suppose that we already have the statement for all 
choices of exponents {k*(S, p)} \s\=2,o<p<m with {&:*(S,0)}| S | = 2 arbitrary and so that 

k*{S,p) <k{S,p), k*(S 0/ p ) <k(S Q ,p Q ) (5.11) 

for |S | = 2 and p > 1. Thus Theorem 2.3 amounts to the base case of our induction. 
For notational convenience let 



pfc(S ,p )-l 
So-Po 



II n 

(S,p)^(S , Po ) 



k(S,p) 
S,p ■ 



(5.12) 



By symmetry we have 
/ 



EI r; 

SC[n] 
0<p<m 



,k(S,p) 
S,p 




(5.13) 



l<Kpo 



A slight variation on the argument from Theorem |5 . 1 1 implies that 



n n 

SC[n] 
\0<p<m 



k(S,p) 
S,p 



J 



N 



(k(S ,p ) - l)qi Vo v 



T 

'S 0/ po 



+ 



N 



E Hs lr pi)s Sl/So Q Vl - 



(Si,pi)^{S ,po) 



N 



T 



r. 



Si,pi 



R 



+ R 



+ 0(k + l) (5.14) 



where we interpret a term in which a coefficient evaluates to as being 0. 
To check the induction step, notice that 



R 



R 



R 



+ R 



{n,r 2 } ~ i {r 1 ,£(r 2 )} 



r {ari)S2} + T {anU(ri)}- 

(5.15) 



By Lemma 3.4 for each pair of replica indices such that {£, t'}A{r\, r{\ ^ 



\v(TT. 



0(Jfc + l). 



(5.16) 
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Thus we have 
/ 



n m 



k(S,p) 



\ SC[n] 
\0<p<m 



N 



(k(S ,p ) -l)Q2 Po v 



o,po 



+ Xr E MSi,PiM Si/ s <?pi+po v ( 



+ |8 2 ^v(^T {il#f2} )+0(fc + l). (5.17) 
By our assumption on the covariance structure of {Ys,p} and the strong induction 



hypothesis, 



/ 



n 4 S,P) 



\ SC[n] 
\0<p<m 



= N-iM(S )E 



) 



n n); 



k(S,p) 



0<p<m 



+ 0(k + l) (5.18) 



where 

M(S ) = {k(S , p ) - 1) ?2 Po E 



y; 



■fc(S ,po)-2 j-j" yk(So,p) 



S ,p L L * (S ,p) 

P<Po 



+ E fc ( S 0/Pl)?pi+po E 

Pi<Po 



y fc(So,po)-lyfc(So,pi)-l T-T yfc(S 0/ p) 

S ,po S ,pi 1 1 (S ,p) 

P^{Po,Pi} 



+ /% E 



V fc(S ,po)-l 1 T y/C(S ,P,)y 

*So,po 1 1 (S ,p) ls o-° 

P<Po 



/fc(So,p), 



Using the Gaussian structure of the family {Ys ,p}o<p<); 



E 



y; 



So/Po 



Y (So,p) Ys o,° 



P<Po 

(/c(S 0/ po)-l)E[Y So , po Y So , ]E 

PlT^PO 



ay 



y; 



So,po 



So,po 



(So,p) 



ay 



y; 



p<Po 

k(S ,p )-l 7— |- v k(S 0/ p) 



So/Pi 



So,po 



Y (So, 



P<Po 



p) 



The induction step now follows easily from the covariance structure of {Vs,p}- 



(5.19) 



(5.20) 
□ 



Before going one step further in our sequence of CLT's we need a preliminary calcu- 
lation. 
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Lemma 5.3 Let m, n S N be fixed. Consider Q be a monomial of degree k in the truncated 
multi-overlaps {Tr,p} r e[n),o<p<m u {Te>,p}o<p<m- If So = {ro,n + 1} for some r e [n] then 

v (Ts , P Js G) - v {T So , P Js ) v(G)=0(k + 3) (5.21) 

for any po E N. 

Proof. A calculation along the lines of ( 5.17^ bounding errors using Lemma 3.3 gives 

v (T So ,p T So G) = 



JjQ P o v (G) + f> Qpo v [ T S Q [Tr ,n+1 - T ro £ {n+1 ) - T aro ),n+l + ^(r ),«n+l) ) ) + O (k + 3) . 

(5.22) 

By Lemma [3^4] this gives the approximate identity 



Js ,p Ts G) 



N 



(g) + f epoV (T 2 So G)+0(k + 3) 



In particular we may set po = to obtain 



y kg) 



-v(0) + O{k + 3) 



(5.23) 

(5.24) 

□ 

and an arbi- 



N 1 - pQ 

The lemma follows easily. 

Theorem 5.4 (Joint Moments: \S\ > 1) Consider the family {Ts /P } s<z[ n ],o<p<m 
trary collection of integers {k (S, p)}sc[n],o< P <m- Suppose that k{0, p) = Ofor all < p < m. 
Let k = Esc[n],o<p<m ^ (S, V)- Then we have 

( 



n n\ 



SC[n] 

0<p<m 



k(S,p) 
P 



N- k/ i Yl E 
sc[„l 



n < ( 



0<p<m 



,k(S,p) 
V 



< 



C 



NT 



Proof. Let 



and 



h= £ k(s /P ), /c 2 = E Ks,v)), h= E *(s,p) 



S:|Sj>3 

0<p<m 



|S|=2 
0<p<m 



|S|=1 
0<p<m 



k 3 =EKs, P ) 



(5.25) 



(5.26) 



(5.27) 



|S|=1 



The proof proceeds in three induction steps. At the first step we set k\ = k% = and 
proceed by induction on k$. This will be detailed below. Assuming for the moment 
that we have proved the statement when k\, ki = and £3 is arbitrary an argument 
analogous to Theorem 5.2 shows that the result holds for k\,ki arbitrary. Let us note that 
there is a bit of work to be done in that the initial step for k2 is not covered by Theorem 



2.3 This can be taken care of using techniques along the lines of Lemma 5.3 
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Let us consider the first induction, in which k\ = k 2 = 0. We identify moments by 
induction on £3. The induction hypothesis we use is similar to that of Theorem ! 



5.2 



Consider a collection of exponents {k(S, p)}|s|=i,o<p<w Let (So, po) be chosen so that 
po is maximal and ft: (So, po) 7^ 0- If there are multiple choices of So we choose arbitrarily 
among those with ft (So, po) maximal as well. As an induction hypothesis for £3, let us 
suppose that we have the statement for all choices of exponents {ft*(S, p)}| S | =1 < p < m 
with {ft*(S, 1)}| S | =1 arbitrary and so that 

ft* (S, p) < ft(S, p), ft* (So, po) < ft(S , po) (5.28) 

for p ^ 1. 

The initial step, when £3 = and the remaining exponents are arbitrary, is part of the 
content of Theorem 2.3 We thus proceed to the induction step. Let us denote So = {/o} 
and when we want to be explicit 

(5.29) 
(5.30) 



For convenience let 

By symmetry, we have 
/ 



t = t: 



L S ,p 

?o,Po 



L r ,p- 



t: 



n ^ 

(S,p)/(r ,po) 



k(S,p) 



n ?Tp' v) 



Po 



1 sew 
\0<p<m 



(5.31) 



A slight variation on the argument from Theorem 5.2 using the symmetry of replicas 
implies that 



/ 



n 7i< 



1 sew 
\0<p<m 



k(S,p) 
V 



N 



(ft(^Po) - 1) 7Z 2 p -lV 



Tr , 



Po 



1 1 

+ — E k (ro,Pi)n Pl+Po -i—v 



N 



Pl< P 



N \T ro „ 



1<1<P 

+ ^ ^ v (fffe) 

«{ro,C(ro)}Ui7([p]) V^P^ 



R 



where z denotes a replica disjoint from those introduced thus far and 

d= \{r G [n] : fc({r},p) ^ for some p}| + E K s ,P){P + l 



+ 0(ft + l) (5.32) 
(5.33) 



(s,p) 
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and we interpret a term in which a coefficient evaluates to as being 0. 



Now, we have the identities used previously in Lemma 4.3 

T r ,p{£) =T r ,p — Ti iP 

R r ,( - R ar )A =T {r ,£} ~ %(»•„)/} + T r ,l ~ %r ),l 

if £ is the image of an a. and 

R r ,( - R ar ),e =T {r ,i} - T {«r ),n + T r ,l ~ T £(r ),l 

if £ is in the image of a 7. 

Noting that the overlap involves a free index in the remaining summands, inserting 
these two identities into their respective summands and applying Lemma 3.4 whenever 
possible gives 



V ( T { R roMl) ~ R aro),W) ) ) = V [ R ^ ~ R aroU) ) = V (^o,l) + 0(k + 1), 

T 



T S/P (£) (Rr j - R z(r ),e) ^ = v (FT T0) i) + 0(k + 1) if £ is the image of an a, 

T S,p{ £ ) ( R ro,£ ~ %^)) = V (^rcl) + $S,{r } V (^^S^p-l^W} 



Ts,p( £ ) 

Ts,p{£) • 'J \ ± i>,p 

+ 0(k + 1) if £ is the image of a 7. 

Collecting terms we have 

/ n T s,r P) 

\ SC[n] 
\0<p<m 

JV \ 1 r ,pa/ JV pi<p V J ?-o,pi / 

+ £ 2 {PoTTpo-2 - Oo + 2)7T po } 1/ (^r r0/ i) +p 2 7T po {k{r ,po) ~ l)VQV \7^-T{r Q z}, Va -\T{r Q ,z}; 

\ 1 r ,po 

+ p 2 7i po £ k(r Or p 1 )p 1 v(^T {r0rZhp ^ 1 T {rOfZ}/1 ) +0(* + l) (5.34) 

pi<p V-'l'O/Pl / 

where as usual we interpret terms with coefficient as being and z is a new index. 
The induction hypothesis and Lemma [53] imply 



v(FT TOtl )= £ v(T ro , n T roA )v(-^— A+0(k + l). 

P!<p \ al r ,pi J 

k(r , Pl )v (^—T {ro , z} , pl -lT{r ,z^j =V (T{r Q ,z}, Pl -lT{r ,z}) v (^—^J +0(fc+l). 
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Gathering these observations together, 



11 T k s f p) \ =B(p ,p )v(-^—A+ £ B (p 0>Pl )v(-^—A+O(k + l 

SC[n] / \ 01 r ,Po / Pl <p \ oi r ,pi J 



SC[n] 
0<p<m 



(5.35) 



where 



= j-jKp+p-i +P 2 [prtp-2 ~ (p + 2)tt p ] 1/ (T r0/? T r0; i) +p 2 pn p v (T MrP -{T. 



'■{r 0r z},p-l*{r ,z},l 

(5.36) 

The result now follows from Lemma 4.3 and the induction hypothesis. □ 

Lemma 5.5 Lef m G N fee /i'xed and Q be a monomial of degree k in the truncated multi- 
overlaps {T , p }o<p< m . Then 

v {Ti, v J U Q) ~ v (T Vo T u ) v (G) = O (k + 3) (5.37) 

fo each po e N. 



Proof. The statement follows from slight modifications to the argument of Lemma 5.3 



□ 

Theorem 5.6 (Joint Moments: The Full Picture) Consider the family {Ts,p\sc.\n\,o<p<m 
and an arbitrary collection of integers {k (S, p)}sc[ n ],o<p<m- Let k = Yl(s,p) k P)- Then we 
have 



n t s, 

As,p) 



k(S,p) 

p 



N- k/ > n e 

sew 



p=0 



*(S,p) 

p 



< 



C 



(5.38) 



Proof. Let us define 

fc 1= £ k ( S 'P)' k 2= E M^P)- (5-39) 

(S,p):|S|>l 0<p<m 

Similar to our previous arguments, we may reduce to the case k\ = 0. Now the canonical 
pair is (0, 2) and we will prove the remaining identifications by induction on 

k 2 ='£k(0,p). (5.40) 

p^2 

To state our induction hypothesis, let po be maximal so that po 7^ 2 and k{0, po) 7^ 0. 
Suppose that we have the statement for all choices of exponents {k*(0, p)}o<p<m with 
{k*(0, 2) } arbitrary and so that 

k*{0,p) <k{0,p), k*{0,p o ) <k{0,p o ) (5.41) 

for p 7^ 2. The case £2 = and A:(0, 2) arbitrary is part of Theorem 2.3 
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To check the induction step at k 2 = K > 0, let us fix a monomial 

]1 T k sf P) (5-42) 

l<p<m 

with k 2 degree K and so that po is maximal with po 7^ 2 and fc(0, po) 7^ 0. Let us denote 
the total degree of this monomial by k. For notational convenience let us define the 
monomial T by 

l<p<m 

As usual we have by symmetry 

V (r 0/Po ^) = ^ (fc(0,p O ) - 1) (<?2p - 2c lp ) v 

Now we may expand this product using a total of d = Yj\< P <m k{ ' V)V replicas. By 
Lemmas 3.2 3.1| and [33] 



jV° ~ ^ F^J = f (Vpo-2 ~ Into) ( P 2 °)v(^T £ 



,2) 



+ /3 2 ^±22 (^ po+2 - q Po q 2 ) v {TT , 2 ) 
- p 2 p d (q po - q po q 2 ) V (^T 0/2 ) 

- ftd (q po+2 - q Po q 2 ) £ v ( T £,l + T 0,2)) 

ttv([Po]) 

+ P 1 (<7 Po " E 17 { T ( T {lf'} + T <',1 + ) 

<e?([p ]) 
*'6/([po]) 

+ P 2 {q Po +2-q Po q 2 ) E 17 ( T W + T lA + T M + T ^)) + 0(k + 1) (5.45) 

{e,e'}nr,([ Po ])=0 

Consider terms four and five. We write T = f^jjj T , p (£). Since 

T , P {e) = + T 0/P (5.46) 



we have 



v 



v [T {T £A + r 0/2 )) =1/ (T^-iT!,!) 1/ f + i/ (r 0/2 ^) + 0(fe + 1) 

V 1 0,p J 

{?{(,(>} + T t'A + ^2)) =v (Ti,p_iT w ) 1/ (^-J + i/ (r 0/2 ^) + 0(fe + 1) 



where we have used Lemmas 3A_ 5.3| and [53| 
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For the sixth term, there are two cases to distinguish: either the replicas £, £' appear in 



the same truncated overlap or in distinct truncated overlaps. By Lemmas 3.4 5.3 and 5.5 

T 



i T {U'} + T U + T £>,i + T 0,2)) = v ( T{\,2}, v -iT{\,2} ) + 2v (Ti,p_iT w 



if £, £' come from the same overlap and 

v [T (T { e r£ , } + T41 + T (l/1 + T 0/2 )) = v (T\, V -\T\,\) v 



+ v(FT , 2 ) + O(k + l) (5.47) 



T 



■ 0,p 



+ v (T^-xTu) v f ^ J + V (^T 0(2 ) + 0(* + 1) (5.48) 

V ^ 0,p' / 

if £,£' come from distinct overlaps T 0/ p(£), T y(£') respectively. 

All that remains is to collect terms. It is most convenient to collect the contributions 
coming from a fixed replica first. For each £ £ 7([po])/ the term v ( J appears with 
the coefficient 

f { (q Po +2 - q Po qi) (-1 - Po) + (<7po " q Po qi) Po} v (Ti /P _iT u ) 

+ V ~Y L (<?Po+2 - ^2) v (r {1/2}//; _ 2 T {1/2} ) . (5.49) 



where we have counted the term v \T{i r 2},p-2T{i,2}j contributed by the pair {£,£'} as a 
one half contribution to each of v ( T :F (n ) , v ( T ) . 



WO 



On the other hand, v [T1 0, 2 ) appears with coefficient 

^ A Po = £ 2 (2°) - 9po7z) + ^ ( P ° ^ ^ ("?Po+ 2 ~ ^ 2 ) ~ (<?Po " <?Po<?2) • 

(5.50) 

Using symmetry of replicas in the v measure we thus have 

v {T 0/VQ F) = (*(0,p o ) - l)M*(p )v ' ' 



r, 



0,po 



+ X] M^P)-M(p)"(^) +/3 2 A po v(T 0/2 ^)+O(fc + l). (5.51) 
p^po \ J 0,p/ 



where 



M*(p Q ) = — (<? 2po - 2<? po ) + K p0/Po t/ (Ti^-iT^) + o> po , po i/ (r {1/2}po _ 2 T {1/2} ) (5.52) 



and 



M(p) = jj (q p+Po - q p q Po ) + K po , p v (Ti, p _iT w ) + w po , p v (T {1/2}p _ 2 T {1 2} J (5.53) 



CLT FOR MULTI-OVERLAPS 



27 



where, as usual, if a coefficient is then we interpret the summand as being 0. 
By the (strong) induction hypothesis, 

9 



l<p<m 



T\ + 0(fc + l). 



(5.54) 



Of course k(0, p)v ( ^— \ = v ( ^f—^F\ , so collecting terms, comparing them to Lemma 



4.4 and applying the induction hypothesis to get 
3 



dT 



-T 



0,f 



E 



0,p' 



V fc(0 /Po )-1 
■ r 0p o 



P^PO / 



+ o(k-i] 



finishes the induction step. 



(5.55) 



□ 



6. Appendix 

Here we provide proof of the main tool for estimation of the errors incurred in the 
application of Lemma 3.1 We shall use the inequality for overlaps due to Talagrand 
mentioned in the introduction. 

Lemma 6.1 [Theorem 2.5.1 [7JJ There exists a /3q > such that for all fi < fa, 



k 



>'(^i.2-?2) 2fc ) < (^) (6.D 



for all ft: G N. Here L > denotes a constant which is independent ofk, N. 



Lemma 6.2 Let jSo be as in Lemma \6.1\ Suppose S C N is finite and let p S IN be fixed. 
Consider the truncated overlap T$ /P . For all /3 < /3o and any ft S N, there exists a constant C 
depending on S,p,k( and fS) so that 

%) <- ^ <«> 



and 

a\ ^ C(S, P ,t) 



Proof. We prove these inequalities simultaneously by induction on ft. Let us note that we 
are not after exponential moments here. It does not seem clear that we obtain exponen- 
tial moments uniformly in fio over arbitrary choice of pairs (S, p) without a more careful 
consideration of the interpolation term. This would require more delicate analysis than 
we need, and so will not be pursued here. 
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Consider the case k = 1. Using the symmetry of sites, 

fa)=»(n('-^)]V , 



4 v (n ( £ ' - e?w ) n £,< " n (' - ** w ) rp (,) ) + » fn ( £ - - ^) 

\reS /=1 reS (=1 / \reS / 



On the other hand, Lemma pTT| implies that we have 



n 



\(GS 1=1 

This implies the bound 



It follows easily that 



2\ s \ 

< -=v I ( t; 



4l s l 2l s l 



s, P 



2\ 2 



2is| 

2 ■'(/;,,) 2 



N 



^ISI 



t/(T q z J <—+2—v(Tl p ) +2 



S '*V ~ N ^ 



N2 



4ISI+2 
N 



(6.4) 



(6.5) 



(6.6) 



for all N sufficiently large. The bound for T s follows from ( |6.4[ |. 

For the induction step suppose that we have proved the statement for all k < m. 
Proceeding as above, 



v T; 



-2m +2 



L S,p 



Now we may write 



where 



,reS 



1=1 



L s, P 



S,p 



2m+l 



2m /2m 4- 1 

1*1 <E 



s=0 



•S,p 



+ £ 

2 |S|(2m+l-s) 



]\j2m+l- 



By Holder's inequality and the induction hypothesis 



so that 



s,p 



v(\£\)< 



<v T. 



2m \ 2m (" 
5 < 



(2m + l)2l s l / C 2l s l 



- N s/ 2 

x 2m 



N 



+ 



(6.7) 

(6.8) 
(6.9) 

(6.10) 
(6.11) 
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By Proposition 2.4.7 of 



1=1 

<2d 2 [l 2 exp{M 2 p 2 )v^(T S/p y ' ") v{{R li2 -q 2 

where d = (2m + 2) (\S\ + p) + |S|. 
Since 



vJ-eS 

2m+l 
2m+2\ 2m+2 



1=1 



1 

\2m+2\ 2m+2 



;=i 



(6.12) 



(6.13) 



we have 



2m+2\ 2m+2 



. 2m+l 

/ _ _\ „ „ „ „ // \ 2m+2 \ 2m+2 / 

v (T 2 ™+ 2 ) < IdYexp (MY) v [(Tl v ) J v ((R 1/2 - ?2 ) 

To get a workable inequality we make one more observation. Similar to ( |6.8| l we have 

/ \ 2m+2 



T 2m+2 , c 
1 S,p 



where 



s=0 



s 2 |S|(2m+2-s) 
^ S >P I ) ]sj2m+2-s 



Applying the knowledge (from Lemma |6.1| that 



v (^(Ri,2 - qz) 
and Minkowski's inequality gives 



2m+2\2m+2 L 



< 



N 



T 2m p +2 ) <2d 2 p 2 exp(4d 2 p 2 ) 



v{T 2,n+2 



+ N 



+ 



N \N 



(6.15) 
(6.16) 

(6.17) 
(6.18) 



where C is some appropriately chosen constant. The first statement of the induction 
now follows. To see the second statement, we refer the reader to (16. 151). □ 
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